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A Note on the Size-Sensitive Packing Lemma 


Nabil H. Mustafa* * 


Abstract 

We show that the size-sensitive packing lemma follows from a simple modification of the standard 
proof, due to Haussler and simplified by Chazelle, of the packing lemma. 


1 Introduction 

In 1995 Haussler Q proved the following interesting theorenO- 

Theorem 1 (Packing lemma ||5l Lemma 5.14, p. 156]). Let {X, V) be a set-system on n elements, and with 
VC-dimension at most d. Let 6 be an integer, 1 < 6 < n, such that |A(ii, S')! > 6 for every R,S€'P, 
where A{R, S) = {R\S)U{S\ R). Then \V\ = 0{{n/6f). 

Haussler’s proof is a beautiful application of the probabilistic method, and was simplified by Chazelle (I]. 
We refer to the discussion in ||5]| for motivations and applications. Recently much effort has been devoted 
to finding size-sensitive generalizations of this result. After a series of partial bounds |l3ll3, the following 
statement has been recently established in lH, via two different proofs (one building on Haussler’s original 
proof while the other extends Chazelle’s proof): 

Theorem 2 (Size sensitive packing lemma). Let {X, V) be a set-system on n elements, and letd,di,k,6 > 0 
be integers. Assume the system has VC-dimension at most d. Further, assume that for any set Y C X the 
number of sets in V\y of size at most r is at most /(|y|, r) = If |A(ii, S)\ > 5 for every 

R,S €r and | 5 | < k for all S € V, then \r\ = 0{n'^^k^-'^^/6'^). 

The objective of this present note is to point out that Theorem |2j with a simple trick, is an immediate 
consequence of the textbook proof Q of Theorem [T] 


Haussler and Chazelle’s Proof. We rewrite the main step in their proof in a slightly more general form: 


Lemma 1.1 (ID Proof of Packing Lemma 5.14, pp. 157-159]). Let {X,V) be a set-system on n elements. 
Let d, 5 be two integers such that the VC-dimension ofV is at most d, and | A(S', T)| > 6 for ail S,T £ V. 
Then 


\V\ < 2 • 1], where A' is a random sample of size 
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*In what follows below, we refer the reader to Matousek’s textbook (5] Section 5.3] for notations and proofs. 
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Proof. Let W, Wi , A, s = be precisely as defined in the proof in the textbook ||51 Proof of Packing 
Lemma 5.14, pp. 157-159], where the following relations are proven: i) 2d\V\ > E[iy] = s ■ E[VLi], where 
the expectation is over the choice of A, and ii) E[kLi|^' = — l^|y|)> where A' is set to a fixed 

Y, and the expectation is over the choice of a random element in X \ y. Together they imply the lemma: 

2d\V\>nW] = s-nWf>s-(^ Y, ^-{^'P\-\P\y\) = y]) =4d|iP|-4dE[|iP|^,]. 

ycx 

|y|=s-i 

□ 

The proof in lO Proof of Packing Lemma 5.14, pp. 157-159] uses the primal shatter lemma to conclude 
the proof of Theorem[T} \'P\a'\ = 0((4dn/5)'^) for any A' of size s — 1. Now we show that the proof of 
Theorem |2] is also a similar step away, by using instead the size-sensitive bound given in the assumption. 

Proof of Theorem|2l Let A' Y X he, a random sample of size — 1. Let Vi = {S & V s.t. |5 n > 
3 • Mk/5}. Note that EdS n A'\] < Adk/5 as |5| < k for all S £ V. By Markov’s inequality, for any 
S £V, Pr[5 € Vi] = Pr[|5 n ^'| > 3 • Mk/6] < 1/3. Thus 

E[|7’|.,.|l < E[|7 :>i||+E[|(P\Pi)|A'I 1 < E Pr[S 6 V^\+f(\A'\,12dklS) < 

s&v 

where the projection size of P \ Pi to A' is bounded by /(•, •). Applying Lemma fTTl finishes the proof. □ 


Discussion. Besides a dramatically shorter proof, our proof also improves the constants in the bounds. 
Furthermore, we have shown that it follows without any modification or addition to the Chazelle-Haussler 
proof. The somewhat subtle key idea that was missed by earlier work EO is that it is fine if E[|P|yi/|] is 
bounded in terms of c|P| for a small-enough constant c, as in any case it would be absorbed by the LHS 
of the equation in Lemma 11.11 This allows us to replace the complicated technical machinery developed 
in earlier work (iterative processes, Chernoff bounds for hypergeometric series, complicated probabilistic 
computations) for over 20 pages-long proofs by a mere Markov’s inequality. 
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